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TITLE OF THE INVENTION 

SURFACE INSPECTION SYSTEM 
BACKGROUND OF THE INVENTION 

Figld of the Invention 
5 The present invention relates to an inspection system for work 

boards (boards to be worked) such as building boards, and in 
particular, to an inspection system for identifying work boards and 
automatically inspecting the surface of work boards that have been 
treated in each manufacturing process. 

10 Description of the Related Arts 

Cn the conventional continuous work line of work boards, for 



instance, the shape andVolor tone of a semi - finished product are 
frequently caused to change on every occasions after finishing each 
manufacturing process. For example, in a continuous coating line 
15 of building boards, the coloAtone of the building board is caused 
to apparently change upon finishing each manufacturing process even 
if the original shape of the buir^ing board or work board is not 
changed . 

As mentioned above, the external appearance of semi - finished 
20 product to be shown after finishing each manufacturing process in a 
continuous work line is frequently caused to change more or less as 
compared with the external appearance of the same semi - finished 
product obtained in the previous manufacturing processes. 
, In such cases, instead of performing an inspection of 



25 individual building board at each manufacturing process thereof, an 
inspection process is usually performed at the final stage of 
manufacturing process so as t\ perform the inspection on the 



finally finished product. The building board that has passed 
through this inspection is then usually marked with a specific 
manufacturer's serial Vnumber so as to make it possible to 
distinguish each building board by this serial number. The reason 
for performing the inspection at the final stage of manufacturing 
process may be attributes to the fact that it is very difficult to 
uniformly impose the inspection conditions in the midway of the 
manufacturing process. FoA exajnple, the object of inspection may 
not be moving along a f ixedXlocation of transferring line, or the 
object of inspection just transferred from a drying process may 
inevitably undergo a physical* or chemical change due to a thermal 
change with time. Namely, thelfact that the object of inspection 
is not necessarily in a stable\state in the midway of the 
manufacturing process is seemedlto be one of the reasons for not 
performing the inspection in theVnidway of the manufacturing 
process . 

However, if an unexpected inappropriate coating treatment is 
happened to be performed in a continuous coating line to thereby 
generate a non- uniformity of coating, an inappropriately coated 
semi -finished products will be unavoidably subjected to the next 
working process since it is impossible to find out such an accident 
unless the coated state is always watched. As a result, it will 
bring about a serious problem that defective building boards will 
be continuously produced in large quantities. 

Even so, it may be severe to entrust an operator with such a 
watching operation, and moreover, such an idea is undesirable in 
promoting the labor saving. 

On the other hand, a line monitoring system using a television 
camera is widely adopted in a manufacturing plant. However, most 



of them are employed for the purpose of watching if there is any 
abnormal moving of work boards. Namely, there is no case wherein 
the line monitoring system is employed for the purpose of 
inspecting any change in the external appearance or color tone of 
work boards at each manufacturing process. 

Of course, there is a case wherein a monitoring system is 
employed for watching various controlling items such as temperature, 
humidity and pressure at each manufacturing process. However, as 
far as the inspection and evaluation of semi - finished product 
obtained from each process are concerned, it is inevitable at 
present to rely on the operator's naked eyes. 

Meanwhile, when any defect is found on a finished product and 
the cause thereof is attempted to trace, the manufacturing plant as 
well as the produced date of the defective product can be 
identified from the specific manufacturer's serial number thereof. 
However, it would be impossible to trace the specific manufacturing 
conditions under which the product is produced at each 
manufacturing process, so that it would be impossible to trace the 
fundamental cause for the production of the defective product. 



The present invention has been made to solve the 
aforementioned problems. Therefore, an object of the present 
invention is to provide an inspection system which enables even in 
the production control section located at a remote place to trace 
and inspect how large the external appearance of a great number of 
work boards, that have been placed on a continuous work line, will 
be changed after undergoing through each manufacturing process. 



SUMMARY OF THE INVENTION 



<sas= =Another object of the present invention is to provide an 
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inspection system wh^ch is capable of identifying the individual 
work board and of recording the manufacturing conditions of the 
individual work board evVi if the external appearance of work board 
is liable to change in the\manuf acturing process of the continuous 
5 work line. 

\§) ^Namely, according\to the present invention, there is provided 
an inspection system, wftich comprises a line sensor for one- 
demensionally imaging an elongated work boards, a velocity- 
measuring means for measuring a moving velocity of the work board, 

10 a sampling control means f or Vrontrolling the sampling of said line 
sensor on the basis of the moving velocity of the work board to be 
measured by said velocity-measuMng means, and an image- composing 
memory for composing an output of\said line sensor to generate a 
two-dimensional image data, 

15 The velocity-measuring means is designed to measure the 

rotational velocity of a transferring roller for transferring the 
work board, thus making it possible to easily and accurately 
measure the moving velocity of the work board. 

*MThe inspection system may be further provided with a 

20 controlling means to correct the sampled image data based on how 
extent the work bord is slanted, thereby making it possible to 
easily compare the image data wr^h that of image data of a standard 
work board or other work board. 
^iS * SS5s ^Further , the inspection system may be further provided with a 

25 data transmitting means fo\ assigning a transmission channel to 

every work boed and assembling the image data into the data -packets 
so as to transmits them, therebW making it possible to effectively 
transmit the image data without causing a collision between the 
lots of packets. 



When the inspection system is provided with a detecting means 
for detecting a work board on a work line, time -measuring means for 
measuring a detected time when the work board is detected by said 
detecting means, and identifying means for identifying the work 
board using said detected time measured by said time -measuring 
means, it becomes possible to easily distinguish individual work 
board which is generally difficult to distinguish from others by 
the external appearance. 

The detecting means is designed to detect the work board going 
into a prescribed manufacturing process and the work board going 
out from said prescribed manufacturing process, thus making it 
possible to facilitate the delivery of an identification 
information between a couple of successive processes. 

The detecting means detects a leading and a trailing end 
portion of the work board to be transferred, thus making it 
possible to facilitate the delivery of an identification 
information between a couple of successive processes. 

The identifying means is also designed to identify the work 
board by way of a manufacturing process and the time when the work 
board has passed through said manufacturing process, thus making it 
possible to identify the work board in relative to each 
manufacturing process, i.e. by referring to the specific 
manufacturing process and time the work board has passed through. 

The identifying means identifies the image data of the work 
board which has been gone out from a manufacturing process by way 
of said manufacturing process and the time when the work board has 
passed through said manufacturing process, thus making it possible 
to identify the image data of the work board after each 
manufacturing process. 
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BRIEF DES PT?TPTION OF THE DRAWINGS 



A more complete appreciation of the invention and many of the 
attendant advantages thereof will be readily understood by 
reference to the following detailed description and the 
accompanying drawings, wherein: 

FIG. 1 is a top view illustrating schematically a part of the 
continuous work line which can be suitably applied to the 
inspecting system of work board according to one embodiment of the 
present invention; 

FIG. 2 is an enlarged schematic view illustrating a main 
portion of the continuous work line shown in FIG. 1; 

FIG. 3 is a schematic view illustrating the arrangement of the 
inspecting process portion; 

FIG. 4A is a block diagram illustrating an internal 
configuration of a CCD line sensor camera shown in Fig. 3; 

Fig. 4B is a diagram illustrating the measuring points; 

FIG. 5 is a diagram illustrating changes of line reading rate; 

FIG. 6 is a diagram illustrating the accumulation of image 
data in an image- composing memory ; 

FIG. 7A is a case where a work board is not slanted; 

Fig. 7B is a case where a work board is slanted; 

Fig. 7C is a diagram illustrating a methode of calculating the 
angle of diviation; 

a <=^P$&**= =8A if . a^X- Y cor dinate c r~o £ ^a work b oa rd-; * 



Fig. 8B is a diagram illustrating the position of a work board 
when the work board is slanted; 

FIG. 9 is a diagram illustrating a relationship between a 
composed image data of a board and an image data to be displayed; 




FIG. 10 is a block diagram illustrating the constructions of 
the manufacturing process controller and those of the production 
controller; 

FIG. 11 is a flow chart indicating the operation of the 
5 manufacturing process controller; 

FIG. 12 is a flow chart indicating the operation of the board 
identification section; 

FIG. 13 is a flow chart indicating the operations of the image 
data sampling and that of the image compose control; 
10 FIG. 14 is a flow chart indicating the operation of the packet 

s :fc | control ; 



FIG. 15 is a diagram illustrating an example of the 



construction of the transmission packet; 




FIG. 16 is a diagram illustrating an entire sequence of each 



transmission packet; 




accumulated in the received data accumulating memory; 



the transmission system and those of the production controller; 



FIG. 17 is a block diagram illustrating the configurations of 



FIG. 18 is a diagram illustrating an image file to be 
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FIG. 19 is a diagram showing an example of displaying the 



image of work board in the display; and 



FIG. 20 A, B, and C are a flow chart indicating the operation 



of the production controller in FIG. 1; 



DESCRIPTION OF THE PREFERR ED EMBODIMENTS 
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Preferable embodiments of the present invention will be 




explained in detail with reference to the drawings. 
5 ^TfFIG. 1 is a top view illustrating automatically a part of the 
continuous work line which can be suitably applied to the 



inspecting system of work board according to one embodiment of the 
present invention. In thte following explanation, a building board 
1 is exemplified as the woYk board. A raw board 1 of the building 
board goes at first into a Manufacturing process (1) in the 
direction of an arrow Al . Affcer finishing a working in the 
manufacturing process (1) , thA work board is inspected at an 
inspection process (1) and then, moved to the next manufacturing 
process (2). After finishing a Working in the manufacturing 
process (2) , the work board is inspected at an inspection process 
(2) and then, changes the moving direction to move the next 
manufacturing process (3) . After Mnishing a working in the 
manufacturing process (3) , the work\board is inspected at an 
inspection process (3) and then, further turned and delivered in 
the direction of an arrow A3 for subjecting it to the next 
manufacturing process. 

<l A great number of workNjoards 1 are intermittently gone at 

^predetermined intervals into ythe continuous working line in this 
manner. After finishing a predetermined number of working 
processes, the work boards are ultimately gone out from the 
continuous working line. During Vhese working processes, the work 
boards are moving in individually \>ver the continuous transferring 
line . 

There is an upper limit with respect to the total number of 
work board that can be placed on the! transferring line as the 
transferring lines are steadily operated. 

On the other hand, as far as each manufacturing process is 
concerned, the time when the work board 1 goes into the prescribed 
manufacturing process as well as the ftime when the same work board 
1 goes out from said prescribed manufacturing process can be 
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represented by an absolute ^alue of time of working (it means that 
the time elapsing minute by minute would never go back) which is 
applied to individual work bcbrd 1 in said prescribed manufacturing 
process. The work boad 1 may Igo into and out from the 
manufacturing process at the same moment in other manufacturing 
processes. However, as far as| a single specific manufacturing 
process is concerned, the timel when the indivudual work board goes 
into and out from the manuf act jring process is a value peculiar to 
this individual work board 1. This will be specifically explained 
10 in the followings. 

For example, assuming that the work line is operated in a 
steady state, when a work board 1 goes into at 10:00 in the 
manufacturing process 1 and thon, goes out from the manufacturing 
process 1 at 10:10 as scheduled, this 10 minutes of working during 
15 which this work board 1 has beon treated in the manufacturing 
process 1 can be represented by three data (process number « 1; 
going-into time = 10:00; and going-out time « 10:10). From these 
data, it can be shown that this work board 1 lies in the 
manufacturing process 1 for receiving a treatment during this 
20 period of time. 

Supposing that this work /board 1 goes out at 10:15, there is a 
possibility that any kind of /trouble may has been occurred in this 
or other manufacturing process. Specifically, when this work line 
is temporarily suspended due to a trouble that has been occurred in 
25 this manufacturing process J or in other manufacturing process, a 



delay would be caused in t 
impossible to determine if 



:fie going-out time. Therefore, it is 
the work board 1 to be inspected has 
been really worked in a stfeady state, knowing only the going-out 
time . 

9 
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FIG. 2 is a enlarged schei 
portion of the continuous worl 
detecting light emitted from <. 
intercepted by the leading enc 



*\iatic view illustrating a main 
line shown in Fig. 1. When the 
photoelectric switch SW1 is 
portion of work board 1 as the work 



switch 1 detects that the work 



5 board 1 is moved in the direction of an arrow A, the photoelectric 



board 1 goes into a manufacturing 



process (n) . When the light eitktted from a photoelectric switch 
SW1 is no more intercepted by the trailing end portion of work 
board 1, the photoelectric switch SW1 detects that the work board 
1 going into the manufacturing process (n) is ended and a going - 
into- finish time tie(n) is measured and a scheduled going -out - 
starting time tees (n) is calculated. When the detecting light 
emitted from a photoelectric switch SW2 is intercepted by the 
leading end portion of work board 1, the photoelectric switch SW2 
detects that the work board 1 gding out from the manufacturing 
process (n) is started, and a giing- out- starting time tes (n) is 
measured so as to compare it with the scheduled going -out- starting 
time tees (n) # thereby checking /that the work board 1 is gone out. 
When the detecting light emittjbd from a photoelectric switch SW2 is 
no more intercepted by the trailing end portion of work board 1 # 
the switch SW2 detects that tpe work board 1 going out from the 
manufacturing process (n) is/ended and the going-out-finish time 
tee(n) is measured and a scheduled going- into- starting time 
teis(n+l) to the next manufacturing process (n+1) is calculated. 



25 When the detecting light ei 
intercepted by the leading 



tted from a photoelectric switch SW3 is 
end portion of work board 1 after the 



work board 1 has passed through an inspection process (n) of the 
manufacturing process (n) , the photoelectric switch SW 3 detects 
that the work board 1 going\ into the manufacturing process (n+1) is 
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started, and a going- infto- starting time tis(n+l) is measured so as 
to compare it with the scheduled going- into- starting time teis(n+l), 
thereby checking that the\ work board 1 is gone into. 

When the going -into time is measured and the work board 1 is 
gone out at a scheduled golLng- out- starting time in this manner, an 
inspection or an acquisition of image data is performed. 
Thereafter, when the work fcpard 1 is moved into the next 

scheduled time after finishing the 
process, it is determined that the work 



manufacturing process at a 
inspection in the previous 



board 1 is rendered to receive the next working. 



As explained above, the 



measurement of the going -into time of 



the work board 1, the measurement of the going -out time of the work 



board 1, the determination 



of whether the work board 1 is actually 



next manufacturing process 
based on the unloading ti 



gone out from the manufacturing process at a scheduled going-out 
time measured based on th^ going -into time, the execution of 
inspection following the rAanuf acturing process, and the 
determination of whether %he work board 1 is actually gone into the 

at a scheduled going- into time measured 
e are all designed to be executed by "the 
manufacturing process controller" for controlling this 
manufacturing process. 

Since the scheduled going -out time and the scheduled going - 
into time to the next manufacturing process are all calculated 
estimated values, some degree of tolerance should be allowed in the 
determination of the actual Vtime in view of possibility of 
generating a slight degree of error in moving time of the work 
board 1 due to various factory such as a slippage of transferring 
means . 

The individual work board 1 specified as being a work board 1 

11 



worked in a prescribed manufacturing process as mentioned above is 
treated as corresponding in the relationship of one to one with the 
surface image data (a stationary image data as explained 
hereinafter) of the work board 1, which can be obtained by the 
working in this manufacturing process. Therefore, this surface 
image data is identified by the following "board- specifying key" so 
as to be stored in a recording media. The board data to be 
specified by this board- specif ying key are as follows. 

A board- specifying key 1: dl (process 1; going-into time ti(l), 
going -out time te(D); 

A board- specifying key 2: d2 (process 2; going-into time ti(2), 

going-out time te(2)); 

------------------ / 

A board -specifying key n: dn (process n; going-into time ti (n) , 
going-out time te(n) ) ; 

(n = 1, 2, 3, N; wherein N is an optional integer 

corresponding to the number of processes in the work line) 

The surface image data Pn (n = 1, 2, 3, N) obtained from 

the board data n which has been specified by the aforementioned 
board -specifying key is stored in a recording media in the 
relationship of one to one. 

According to this embodiment, the accumulation of image data 
on the surface of the work board 1 is intended to be recorded in 
compression (for example, JPEG) in a hard disk HDD to be controlled 
by each manufacturing process controller. Accordingly, the surface 
image of individual work board 1 thus recorded can be respectively 
retrieved as an image data file. 
^ «=^IG. 3 is a schematic view illustrating the arrangement of the 



inspecting process portVon. The manufacturing process controller 
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100 (to be explained in detail with reference to FIG. 10) is 
designed to identify \each work board 1 on the basis of the time 
obtained respectively >from the photoelectric switch SW1 (for 
measuring the going- intto time of the previous manufacturing 
process), the photoelectric switch SW2 (for measuring the going-out 
time of the previous manufacturing process) , and the photoelectric 
switch SW3 (for measuring the going -into time of the next 
manufacturing process) . the work board 1 transferred from the 
previous manufacturing prjocess by means of the transferring roller 
31 is detected by a phototelectric switch SW4, and then, the 
transferring velocity thereof is detected by a rotary pulse encoder 
13. Based on this transferring velocity, the sampling rate is 
determined, and the surface of the work board 1 is one- 
dimensionally imaged by msans of a CCD line sensor camera 11. The 
image data obtained by this imaging is accumulated occasionally in 



a hard disk HDD 16. As a 
moving at a varying speed 



result, even if the work board 1 is 
, it is possible to determine the sampling 



timing of image data on tne basis of output obtained through the 
measurement by the rotary\ pulse encoder 13 attached to the 
transferring roller 31 foi\ measuring the rotational velocity of the 
transferring roller 13 whiah is installed immediately below or 
immediately in front of the\CCD line sensor camera 11 positioned 
over the transferring zone dtf the work board 1. 

As for the start and suspension of sampling of image data, 
they can be determined by means of the photoelectric switch SW4 
which is disposed for detecting the passing of the work board 1 
through a position immediately below the CCD line sensor camera 11. 
^sgp ^^IG. 4A is a b\ock diagram illustrating an internal 

^configuration of the\cCD line sensor camera 11 shown in Fig. 3 

13 
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This CCD line sensor canflera 11 is provided with two systems for 
reading, i.e. a system (A) for an odd number line and a system (2) 
for an even number line, thereby enabling it to enhance the 
resolution. The imaged data is fed to an analog -degital converter 
(A/D(l), A/D(2)), in which qhey are converted into digital form. 
As shown in FIG. 4B, the measuring point (1) and the measuring 
point (2) are positioned awa^ from each other along the 
transferring direction of the work board 1 to be moved in the 
transferring direction A. Thebe measuring points (1) and (2) are 
given to be imaged by an optical system (1) 31 and an optical 



system (2) 41, respectively. 



The results thus imaged are then 



photo-electrically converted :>y means of a line photosensor (1) 33 



and a line photosensor (2) 43 



which are to be drived using a CCD 



driving circuit (1) 32 and a fCD driving circuit (2) 42, 
15 respectively as shown in FIG. 4A. The analog signals thus obtained 
through this photo-electric conversion are then converted into 
digital signals. Then, the RGB data of the odd number line is 
temporarily stored in a line image memory (1) 35, while the RGB 
data of the even number line ife temporarily stored in a line image 
20 memory (2) 45, thereby enabling them to be transmitted to an image 
compressing memory 12 of the maflmf acturing process controller 100. 

On this occasion, when the moving velocity of the work board 1 
is assumed to be 60m/min. (or lm/sec.) and the resolution to be 
2.5mm, since there are two line sensors, a line reading pulse will 
25 be generated every 5msec. (2.5 (mm) x 2/1 (mm/msec . ) = 5msec.) (pulse 
rate is 200PPS) . This line reading pulse rate is adjusted in 
proportion to the moving velocity of the work board 1. 

When the moving velocity of the work board 1 is accelerated, 
the line reading pulse rate is also accelerated. On the other hand, 

14 



when the moving velocity of the work board 1 is decelerated, the 
line reading pulse rate is also decelerated. Therefore, even if 
the velocity of work board is varied, the line reading can 
performed with almost the same resolution by immediately conforming 

5 it to the varied velocity. In this case, it is advisable to 

determine in advance a relational expression between the rotational 
velocity of the transferring roller and the line reading pulse rate, 
thereby enabling the amount of shift of pulse to be adjusted 
according to this relational expression . 

10 ,3>S> ^IG. 5 is a diagram illustrating changes of line reading rate. 
When the moving velocityV>f the work board 1 is assumed to be 
lm/sec, at the initial moment (1), the reading of data- sampling 
points 1 and 2 is performed ^respectively at the measuring point (1) 
of the odd number line as well as at the measuring point (2) of the 

15 even number line. At the nextWoment (2) 5 msec after the initial 
moment (1), the reading of the tiata- sampling points 3 and 4 is 
performed respectively at the md^suring point (1) as well as at the 
measuring point (2) . Further, at\ the next moment (3) 5 seconds 
after the aforementioned moment (2) , the reading of the data- 

20 sampling points 5 and 6 is performed respectively at the measuring 
point (1) as well as at the measuring point (2) . Whereas, when the 
moving velocity of the work board l\is accelerated faster than 
lm/sec, the work board 1 is caused \o move a longer distance 
during this 5 seconds, so that the li\e reading pulse is required 

25 to be shifted so as to increase the saifbling rate in order to make 
it possible to read with the same resolution as the previous moving 
velocity at the moment of (2) 1 . 
, ^FIG. 6 is a diagram illustrating the accumulation of image 

data in an image - composing Viemory 12. In this embodiment, only an 
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R (red) signal illustrated. However, this can be also applied 
to a G (green) sign&l as well as a B (blue) signal. Each line 
image memory 35 or 43^ (see FIG. 4) is constituted on the FIFO 
(first- in first-out) bksis and hence, the data can be read out 
according to the line-relading pulse and written in compression in 
the image -composing memory 12 of the manufacturing process 
controller 100. In this cfese, the odd number line data of row 

number nn, i.e. Lol, Lo2 , Lo3, , Lonn and the even number line 

data of row number nn, i.e.lLel, Le2, Le3, , Lenn are 

simultaneously and alternately written while changing the row in 
the memory 12. In this easel not only the board image data but 
also the background image date are simultaneously written in the 
memory 12. However, this probuem can be corrected in a subsequent 
data processing. In this manneV, a board image, to be inspected can 
be composed. 

FIG. 7A is a case where a work board is not slanted. Whereas, 
when the work board 1 slants by an angle of 6 from the ordinary 
moving direction thereof, the image shown in FIG . 7B will be 
obtained. Since it is impossible to compare it with the standard 
work board 1 in this case, the angle of slant 6 is calculated by a 
local main controlling section 101 (see FIG. 10) as shown in FIG. 
7C. Namely, since there is the following relationship between the 
number Ao of pixels corresponding to the width of the work board 1 
and the number A 1 of pixels forming the board on the data sampling 
line (A' is determined on the basis of the xth data sampling line 
as counted from the beginning, which is a line suitable for 
determining A 1 ) : 

cos 6 = Ao/A 1 , 
the following relationship can be obtained: 

16 



6 = cos-KAo/A') 
""Based on the ahgle of slant 6 thus obtained, the affine 
^transformation is perrfc^rmed so as to obtain an image data where the 
slant is corrected. 
5 FIG. 8A is a X-Y cordib^te of a work board. When the position 

(X, Y) is rotated by an angleXof 6 as the work board 1 is diviated 
by an angle of 6 as shown in FIG. 8B so as to obtain the position 
<x, y) as shown in FIG. 8A, theY ollowin ^ equations can be obtained, 
x - X cos 9 + Y sin 6 
10 y - -X sin 0 + Y cos 6 

In this manner, the sampling of Y> oarc * image data on an 
elongated board which is a moving object to be inspected can be 
performed accurately in a non- contact manner and at a high speed, 
and at the same time, when the image data obtained is compared with 
15 a standard board image data that has beeV recorded in advance. This 
offers a easy detection whether or not tti^ occurrence of 
abnormality has been occurred. 

The composed board image data thus obtained is compressed in 
conformity with JPEG and stored in a hard disk HDD 16. Each of the 
20 board image data thus recorded in a hard disk HDD 16 can be 
respectively read out by the use of the aforementioned board- 
specifying key. 

^^^^f 1G ' 9 is a dia 9 rain illustrating a relationship between an 
image data of a composed board (already corrected) and an image 
25 data to be displayed. The aforementioned composed board image data 
is then subjected to a data processing for enabling it to be 
transmitted to a production controller which is located at a remote 
place. Namely, the data compression is performed in order to 
reduce the aforementioned composed Aboard image data to an image 
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size suited for displaying it as a board image in a monitor display 
71 (see FIG. 17) which isk connected with the production controller. 
In this case, it is instructed by the production controller that 
"in what degree of resoluti&n the image should be displayed ?" , so 
that the resolution of monitor itself to be actually displayed is 
taken into account. While the composed board image data is of high 
resolution for the purpose of inspection, the display image data is 
of standard resolution. If the\c° m P ose cL board image data is; the 
number of pixel: md x nd; actual\size: Md x Nd, while a monitor 
display 50 is; the number of pixel: xd x yd; corresponding actual 
display size: Xd x Yd, and if the display reduction ratio 0 , the 
actual display size becomes Md x /3 W Nd x /3 , and the image data is 
compressed in such a manner that md pixel and nd pixel become ; 

(Md x 0) xV/Xd) and 

(Nd x /?) x (yd/^) , respectively. 

FIG. 10 is a block diagram illustrating the constructions of 
the manufacturing process controller 100 and those of the 
production controller according to this embodiment. Detailed 
operation of these controllers will be explained in the flow chart 
shown in FIG. 11. The local main controlling section 101 provided 
with a communication control section 27 is designed to control 
entirely individual control module. The board specifying section 4 
is designed to identify the individual work board 1 by the use of 
the photoelectric switches SW1 to SW3 (2) and the timers (1) (2) 3, 
the result being stored in the memory 5. With respect to the work 
board 1 thus specified, an abnormal moving thereof is judged by an 
abnormality determining section 7 by the use of a timer (3) 6 also, 
the result being stored in a flag register 7a. The sampling 
control section 10 is designed to control the sampling of the CCD 
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line sensor camera 11 by the use of the photoelectric switches SW4 
(8) , the timers (4) 9 and the sampling rate corrected, on the basis 
of the pulse from the rotary pulse encoder 13, by a sampling rate 
calculating section 14. The image -composing memory 12 is designed 
to compose and store a corrected line image data fed from the CCD 
line sensor camera 11. A data compression section 15 is designed 
to compress the data so as to store it in the hard disk HDD 16, and 
at the same time, controlling information is also stored in the 
hard disk HDD 16. A transmitting image data processing section 17 
is designed to prosess the image data for transmission. A 
transmission packet assembling section 18 is designed to assemble 
the resultant image data into a transmission packet, which is then 
held by a packet buffer 19. The packet is subsequently delivered 
by a packet delivering circuit 20 and then subjected to a digital 
modulation at a digital modulation circuit 21 and to a frequency 
conversion for transmission at a transmission CH frequency 
conversion circuit 22. The resultant data is transmitted from a 
wave composing circuit 2 3 via a transmission line to the production 
controller 200. 

On the other hand, the production controller 200 is 
constructed such that the data is received by a receiving circuit 
63 and controlled at a main control section 70 provided with a 
communication control section 74, a controlling signal needed being 
subsequently delivered through a transmitting circuit 73 to a 
transmissing line. The wave composing circuit 23 is 
bidirectionally connected with an inter-process connection 
transmission line. As for the data transmissing system, it will be 
explained in detail with reference to FIG. 17. 

FIG. 11 is a flow chart indicating the operation of the 
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manufacturing process controller 100. First of all, it is 
determined if the system power source is ON (step SI) . When the 
result is NO, the controller 11 forces the procedure to bring into 
a state of standby until the power switch is turned ON. If the 
result is YES, the initialization of the system is performed (step 
S2) . 

In the next step S3, the control of network communication is 
performed, and in the step S4, a board- specifying controlling is 
performed. In the step S5, a line image data sampling and an image 
compose controlling are performed. In the step S6, the packet 
controlling is performed, and in the step S7, a system suspension 
processing are performed, thereby finishing the operation. 
^ ^n the system suspension processing (step S7) , a determination 

^ X 

is performed as to whether t2 - going-out time te(n) (the going- 
out-starting time tes (n\ or the going -out- finishing time tee(n)) is 
abnormal (step Sll) . If \he result is NO and there is no 
abnormality, a determination is performed as to whether t3 = going - 
into time ti(n+l) (the goingt into - starting time tis(n+l) or the 
going-into-f inishing time tie\n+l)) is abnormal (step S12) . If the 
result is NO and there is no abnormality, the operation returs to 
the step Sll so as to continue watching the occurrence of 
abnormality. On the other hand, Vf the result is YES in the step 
Sll or step S12 and there is any abnormality in t2 or t3 , the 
suspension of inspection is instructed to the sampling control 
section 10 and the occurrence of abnormality is transmitted to the 
production controller 200 (step S13)l. The result of the 
determination of abnormality is recorded in the flag register 7a. 
At this time, the timer (3) is started (step S14) and then, it is 
determined as to whether the inspectic\i should be restarted (step 

20 



S15) . If the result is YES and the inspection is restarted, the 
operation returs to the step Sll. On the other hand, if the result 
is NO and the inspection is \ot restarted, it is determined by 
means of the timer (3) as to ^hether a predetermined time has 

5 elapsed (step S16) . If the result is NO and the predetermined time 
has not yet elapsed, the system Vorces the operation bring into a 
state of standby until the predetermined time has elapsed. If the 
result is YES and the predetermines time has elapsed, the system- 
suspending procedure is exerted (s\ep S17) , thereby finishing the 

10 operation. 

«=^IG- 12 is a flow cha^ indicating the operation of the board 
identification section 4 (s^e FIG. 2) . First of all, it is 
determined if the photoelectrYc switch SW1 is ON (step S21) . If 
the result is NO and the photo&lectric switch SW1 is not ON, the 
15 board identification section 4 torces the operation to bring into a 
state of standby until the photoelectric switch SW1 is turned ON. 
If the result is YES and the photoelectric switch SW1 is ON, a 
going-into time tl = ti (n) (the g 
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the going- into- finishing time tie 
(step S22) and the timer (1) is s 



?ing- into- starting time tis(n) or 
n) ) is determined and recorded 
darted (step S23) . Then, it is 



determined as to whether a predetermined time corresponding to the 
time to the going-out has elapsed J ( step S24) . If the result is NO 
and the predetermined time has not yet elapsed, the system forces 
the operation to bring into a state of standby until the 
25 predetermined time has elapsed, /if the result is YES and the 

predetermined time has elapsed, /it is determined as to whether the 
photoelectric switch SW2 is ON / (step S25) . If the result is NO and 
the photoelectric switch SW2 ife not ON, the board identification 



section 4 forces the operatio 



to bring into a state of standby 
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until the photoelectric Witch SW2 is turned ON. If the result is 
YES and the photoelectric\switch SW2 is ON, it is then determined 
whether the photoelectric switch SW2 is turned OFF (step S26) . If 
the result is NO and the phbtoelectric switch SW2 is not OFF, the 
board identification section 4 forces the operation to bring into a 
state of standby until the photoelectric switch SW2 is turned OFF. 
If the result is YES and the! photoelectric switch SW2 is turned OFF, 
an going-out time t2 = te(n)lis determined and recorded (step S27) . 



Then, a determination is madp 
as being the scheduled going 
NO and this t2 can not be as 



as to whether this t2 can be assumed 
out time (step S28) . If the result is 
sumed as being the scheduled going- out 



If the result is YES and thi 
scheduled going -out time, th€ 
Next, it is determined as to 



time, the operation is advanced to the system suspension (FIG. 11) . 



t2 can be assumed as being the 

timer (2) is started (step S29) . 

whether the photoelectric switch SW3 

is ON (step S30) . If the result is NO and the photoelectric switch 

SW3 is not ON, the board identification section 4 forces the 

operation to bring into a state of standby until the photoelectric 

switch SW3 is turned ON. If :he result is YES and the 

photoelectric switch SW3 is ON, the going -into time of the next 

process t3 - ti(n+l) is determined and recorded (step S31) . Then, 

whether this t3 can be assumed as 

time (step S32) . If the result is NO 

and this t3 can not be assumed as being the scheduled going -out 

time, the system is advanced tb the system suspension (FIG. 11) . 

If the result is YES and this &3 can be assumed as being the 

scheduled going-out time, the operation returns to the step S21. 

FIG. 13 is a flow chart indicating the operations of the image 

data sampling and that of the image compose control (see FIG. 3) . 
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a determination is made as to 
being the scheduled going -out 



First of all, it is determined if the leading end portion of the 
work board 1 has reached close to a position immediately below the 
CCD line sensor camera 11 by determining whether the photoelectric 
switch SW4 is ON (step S41) . If the result is NO and the 
photoelectric switch SW4 is not ON, the system forces the operation 
to bring into a state of standby until the photoelectric switch SW4 
is turned ON. If the result is YES and the photoelectric switch 
SW4 is ON, the timer (4) is started (step S42) and the value of the 
rotary pulse encoder 13 is read out (step S43) . Based on this 
value, the correction of sampling rate is calculated (step S44) 
(FIG. 5) so as to determine if there is any change in the output 
value of the rotary pulse encoder 13 (step S45) . If the result is 
YES and there is a change, it is then determined if this change is 
an abnormal value (step S46) . If the result is YES and it is an 
abnormal value, the operation returns to the step S13 (FIG. 11) . 
If the result is NO and it is not an abnormal value, the operation 
returns to the step S45. If the result is NO in the step S45 and 
there is no change in the output value, it is determined whether a 
predetermined time required for the passing of the work board 1 has 
elapsed (step S47) . If the result is NO and the time is not yet 
elapsed, the operation goes back to the step S45. However, if the 
result is YES and the time has elapsed, the sampling of the line 
image data is performed at a corrected sampling rate (step S48) and 
the sampled data is recorded (step S49) (FIG. 4) . After the image 
data is corrected and composed (step S50) (see FIGS. 6-8), the data 
is compressed so as to be stored in the hard disk HDD 16 (step S51) 
After a transmission image data has been processed (step S52) , it 
is determined whether the photoelectric switch SW4 is turned OFF as 
a result of finishing of the passing of the work board 1 (step S53) 
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If the result is OFF and the photoelectric switch SW4 is not turned 
OFF, a determination is made as to if there is an instruction to 
suspend the inspection from the main controlling section 70 of the 
production controller 200 (to be explained with reference to FIG. 
5 17) (step S54) . If the result is NO and there is no instruction to 
suspend the inspection, the operation returns to the step S53 . If 
the result is YES and there is an instruction to suspend the 
inspection, the operation returns to the step S14 (FIG. 11) . If 
the result is YES at the step S53 and the photoelectric switch SW4 
10 is turned OFF, the operation returns to the step S41. 

FIG. 14 is a flow chart indicating the operation of the packet 
irt control. First of all, it is determined if there has been an 

| : | instruction from the production controller 2 00 about the 

n transmission image data (step S61) . If the result is NO, a 

v ^ 15 determination is also made as to if there has been a demand for 
P transmitting a detailed image data from the production controller 

iff 

rii 200 (step S62) . If the result is NO, and there has been no demand 

U1 

I; 3 for transmitting a detailed image data, the operation is advanced 

to the step S66. If the result is YES and there has been a demand 

20 for transmitting a detailed image data, a corresponding image data 
is read out from the hard disk HDD 16 and assembled into a 
transmission packet and then advanced to the step S67. If the 
result is YES in the step S61, the content of the instruction is 
transmitted to the transmission image data processing section 17 

25 (step S64) , and a determination is made as to if the processing of 
the transmission image data has been accomplished (step S65) . If 
the result is NO and the processing of the transmission image data 
is not yet accomplished, the system forces the operation to bring 
into a state of standby until the processing is accomplished. If 
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the result is YES and the processing of the transmission image data 
is already accomplished, the going-into time tl = ti (n) , the going- 
out time t2 = te (n) , the existence or non-existence of abnormality 
and the transmission image data are read out and assembled into a 
transmission packet (step S66) , which is then held in the packet 
buffer 19 (step S67) . When an instruction is transmitted from the 
communication control section 27 to deliver the transmission packet, 
the transmission packet is delivered from the packet buffer 19 
(step S68) . At this moment, it is determined if there has been an 
instruction from the main control section 7 0 (to be explained with 
reference to FIG. 17) with regard to the suspension of delivering 
the packet (step S69) . If the result is NO and there is no 
instruction to suspend the delivering of the packet, the operation 
returns to the initial step S61. If the result is YES and there 
has been an instruction to suspend the delivering of the packet, 
the delivering of the packet is suspended (step S70) . Subsequently, 
a determination is made as to if there has been an instruction from 
the main control section 7 0 with regard to the restarting of the 
packet delivering (step S71) . If the result is NO and there is no 
such an instruction, the operation returns to the step S70 so as to 
continue the suspension of the delivery. If the result is YES and 
there has been an instruction to restart the packet delivering, the 
operation returns to the step S66 . 

-^FIG . 15 is a diagram illustrating an example of the 
construction of the transmission packet. This transmission packet 
is of fixed length and consists of the preamble (PA) PI, a process 
number P2, a process -going -unto time P3, a process -going -out time 
P4, a board image data P5, art abnormality occurrence indication 
flag P6, and the delimiter P7^ 
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v^FIG. 16 is a adagram illustrating an entire sequence of each 
transmission packetX In this case, the packet is represented by 
"provisional board nunber- process number". The time axis A 
indicates the position \f the packet in a specific manufacturing 
process in which the worR board 1 is transferred with time. For 
example, as indicated by 'V-3" , "2-3" and "3-3" in the 
manufacturing process 3, thte work board having provisional numbers 
1, 2 and 3 goes into and goes* out from the manufacturing process 3 
with time. Whereas the time cflxis B indicates the position of the 
packet as a specific work boarckl is transferred through each 
manufacturing process with time. \ For example, as indicated by "3- 
1", "3-2" and "3-3", the work boaz% having a specific provisional 
number 3 goes into and then goes out\ from each manufacturing 
process with time. 

The time axis A extending in the vertical direction in one 
manufacturing process is independent from other manufacturing 
processes, so that there is no possibility that a plural number of 
work boards are placed on the same manufacturing process at the 
same moment, and hence, any of transmission packet would never 
overlap with another transmission packet on the same time axis A. 
With respect to the position of the transmission packet over the 
time axis B for each work board 1, since each work board is 
successively subjected to and gone out from each manufacturing 
process, the position of one transmission packet would never 
overlap with another transmission packet over the time axis B. 

A medium which is capable of securing the elapsing of time of 
an electric signal can be served as a signal transmission line. 
Here, by the use of the time axis A and time axis B, the 
transmission packets each assigned to each work board 1 are placed 

26 



along these independent time axes B, and each transmission- starting 
time is set at a point on the time axis A of the initial 
manufacturing process 1, thereby enabling to grasp the processing 
history of one work board as changes in surface board-working data. 

In accordance with the aforementioned idea, a transmission 
channel is assigned to each work board 1, and the board image data 
that has been obtained and processed by each manufacturing process 
controller 100 is assembled into a packet, thus enabling to control 
the packet according to the assigned channel, thereby making it 
possible to transmit the processing history of individual work 
board 1 as an image data to a production controller which is 
located at a remote place. There is no possibility that each 
packet may overlap with other packet during this transmission 
period. 

FIG. 17 is a block diagram illustrating the configurations of 
the transmission system and those of the production controller. 
Each manufacturing process controller 100 of the manufacturing 
processes (1) to (n) of the A production line is, for instance, 
connected with a multi - transmission line 61 using a coaxial cable, 
and further connected via a connector 62 with the production 
controller 200. On the occasion of transmitting a control data, a 
control channel Cch (bidirectional) will be used, whereas on the 
occasion of transmitting a packet data, a data channels chl-chm 
will be used. The production controller 200 is provided with a 
receiving circuit 63 for receiving the packet, a multiplex- 
separating circuit 64 for separating the multiplexed data, wave- 
detecting circuit 65 for detecting the data signal, a digital 
demodulating circuit 66 for demodulating the data, a received data- 

accumulating memory 67 for accumulating the data, and an image 
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composing memory 68 for composing and storing the data therein. 
The main control section 70 displays the composed image on the 
surface the display 71 (for A line to NN line) as required in 
accordance with the instruction from the key board 72. The control 
data is transmitted from the main control section 7 0 through a 
transmitting circuit 73 to a transmission line, and ultimately 
received by each manufacturing process controller 100. 

FIG. 18 is a diagram illustrating an image file to be 
accumulated in the received data accumulating memory. In this case, 
although the data of each packet shown in FIG. 16 is basically 
accumulated in the receive a data accumulating memory 67 , the 
preamble PI and delimiter P7 are removed. The chl is used for 

accumulating the data of each manufacturing process 1, 2, , n of 

the work board 1 having a provisional board number 1 in the memory 
as an image data file. Likewise, the ch2 is used for accumulating 

the data of each manufacturing process 1, 2, , n of the work 

board 1 having a provisional board number 2 in the memory as an 
image data file 2. 

FIG. 19 is a diagram showing an example of displaying the 
image of work board in the display 71. The surface images in the 

processes 1, 2, 3, of all of the work board to be inspected and 

having board number 1, 2, 3, are allowed to be displayed on a 

single picture screen through the operation of a vertical scroll 
button 81 and a horizontal scroll button 82. 

~<S -=-j?As a result, changes i\ external appearance of the work board 



<P( processed or treated at eacA manufacturing process can be compared 
in relative to each other, sd that it becomes possible to detect 
any non-unif ormi ty in external appearance of the work board that 
might be occurred due to the s\me repeated working process even if 




there has been no problem in the transferring of the work board. 
Therefore, it permits\ to obtain information which is useful for 
accelerating the stabilization of the manufacturing processes, 
^^S^^urther, since a defective work board 1 is encircled by a 

5 ^frame, for instance, ir\ the display thereof, the location of 

manufacturing process asV^ell as the time at which the abnormality 
was generated can be immediately recognized. A window 8 6 will be 
displayed at the left bottorti corner of the display to display a 
going -out time of the work bokrd. Thus, moving a cursor to the 

10 diaplay porion of the work boaid 1, and clicking the mouse botton 
enables to display a going- out tW. 

Furthermore, since a dialog box switch 83 for illustrating the 
operation menu is allocated, the operation menu can be displayed by 
clicking the switch 83. Thereafter, the portion of board image 

15 data transmission is selected from the menu and then, a desired 
display size in the submenu is selected, thereby allowing to 
transmit and display the desired JPEG data of the work board 1 that 
has been accumulated in the hard disk HDD 16 in the selected 
display size. 

20 Additionally, a display title bar 84 such as 11 A production 

line" and a window 85 for displaying the number of work boards 
being processed or treated are also provided in the display 71. 

FIG. 20 A, TEL and C are a flow chart indicating the operation 



of tAie production Controller 200. First of all, a determination is 
25 made as to whether thW system power source is ON (step S81) . If 
the result is NO, the system forces the operation to bring into a 
state of standby until theS^ower is turned ON. If the result is 
YES, the initialization of thV system is performed (step S82) . 

In the next step S83, the controlling of network communication 
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is performed. That is, in the step S84, it is determined if there 
is any instruction prompting to the key input on the board image 
data to be displayed. If the result is YES, an instruction on the 
transmission image data is transmitted to each manufacturing 

5 process controller 100 (step S85) . If the result is NO, the 

operation returns the step S84 . A determination is made as to if 
there is an instruction by the key input to transmit a detailed 
board image data, and if there is a key input by a user (step S86) . 
If the result is NO, the system forces the operation to bring into 

10 a state of standby until the instruction is input. If the result 
is YES and there is the instruction by the key input, an 
instruction is given to transmit the detailed board image data to 
each manufacturing process controller 100 (step S87) . Then, a 



3 determination is made as to if there is an instruction by the key 



iff 



lO 15 input to restart the suspended inspection (step S88) . If the 

result is NO, the system forces the operation to bring into a state 
of standby until the instruction is input. If the result is YES 
and there is the instruction, an instruction to restart the 
inspection is transmitted to each manufacturing process controller 
20 100 (step S89) . In the step S90, a determination is made as to 

whether the transmission packet is received from the manufacturing 
process controller 100. If the result is NO, the operation is 
advanced to the step S95. If the result is YES and the 
transmission packet is received, the counter 69 is count up (step 
25 S91) and the transmission packet is stored as an image file at the 
predetermined portion of the received data -accumulating memory 67 
(step S92) . Thereafter, the image file is read out to compose it 
into a display image (step S93) which is then displayed in the 
display 71 (step S94) . In the step S95, a determination is made as 
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to whether the transmission packet of the JPEG file is received 
from the manufacturing process controller 100. If the result is NO, 
the operation returns to the step S90. If the result is YES and 
the transmission packet is received, the transmission packet is 
stored as a JPEG file in the received data -accumulating memory 67 
(step S96) . Thereafter, the JPEG file is read out to compose it 
into a display image (step S97) which is then displayed in the 
display 71 (step S98) . Further, the number of work boards being 
treated is displayed in the display window 85 (step S99) and a 
determination is made as to whether the system operation should be 
suspended (step S100) . If the result is NO, the operation of the 
system is continued. If the result is YES, the suspension of the 
system is executed (step S101) , thereby finishing the operation. 

It should be understood that the present invention is not 
limited to the above embodiments. 

For example, instead of individually assigning the 
transmission channel to each work board, the transmission channel 
may be assigned to each working process. 

Further, the work material includes any kind of furniture 
boards and doors . 

As explained above, according to the present invention, since 
the sampling of line sensor is controlled by measuring the moving 
velocity of the work board, it is possible to obtain, at a high 
resolution, an image data of work board moving along a processing 
line by the use of a line sensor. 

—Further, according to the present invention, it is possible to 
distinguish it individual wosk board which is inherently difficult 
to distinguish from the other A by the external appearance thereof, 
so that it is possible to accui^itely grasp the progress of working, 
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i.e. the position of ^individual work board in relative to the 
manufacturing process \ Even if a defect is found after the 
delivery of finished bcmrd, the manufacturing conditions thereof 
can be traced in detail , Nsince it is possible to find out the 
accurate time when this defective product was being moved through 
any one of the manuf acturing^processes thereof. 

All publications, patents and patent applications cited herein 
are incorporated herein by reference in their entirety. 
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